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(57) Abstract 

An interactive cable television system is disclosed vvhich utilizes a standard cable television distribution network for 
simultaneously providing a plurality of viewers with an Interactive television program comprising a plurality of signals related 
In time and content Video signals are transmitted in a digital format, more than one signal being multiplexed onto a data stream 
on a single channel. The video signals may be compressed for efficiency. A receiver, in conjunction with a signal selector, 
selects a particular NTSC channel for playback, then selects a particular video signal from the data stream, and decompresses the 
yid^ signal for playback. Seamless switching between video signals on different channels is provided. An alternative embodiment 
is disclosed wherein tiie various signals which comprise the interactive program are switched at the head end rather than at the 
receiver. The multiple choice control unit selects a desired signal by relaying the multiple choice selections of the user 
ttirough a relay box back to a remotely located switching station. The switching station routes the correct video signal down the 
appropriate cat»le channel for the particular user. 

(57) Abr6g§ 

Linvention conceme un syst^me interactif de t6l6vision par c§ble utilisant un r^eau de t616distribution par cSble standard 
afin d'offrir simultan^ment d une plurality de t^Sspectateurs un programme t6l^vis6 interactif comprenant une plurality de 
signaux associds dans le temps et de par leur contenu. Les signaux vid6o sent 6mis sous fonne num^rique. plusleurs signaux 6tant 
multiplexes en un train de donn6es sur un seul canal. A des fins d*efficacrt6, les signaux vid6o peuvent §tre comprim^s. Un 
r^pteur, en association avec un s^ecteur de signaux, s^ledionne un canal NTSC particulier pour la lecture, puis s^lectionne 
un signal vid6o particulier du train de donn^es, et dScompresse le signal vld6o signal en vue de la lecture. On obtient ainsi une 
commutation sans solution de continuity entre les signaux vid^ de diff^rents canaux Selon un autre mode de r^aTisation, divers 
signaux comprenant le programme interactif sont commutes au niveau de la t§te de r6seau plutdt qu*au niveau du r^cepteur. Pour 
s6lectionner un signal voulu, runit6 de commande d choix multiples retransmet, via un boltier relais, les selections d choix 
multiples de I'utilisateur d une station de commutation d distance. Cette station de commutation achemine le signal vid6o correct 
vers I'utilisateur par le canal cdble approprie. 
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(57) Abstract 

An intenctiye cable television system is disclosed which utUizes a stendard cable television distribution networic for simultaneously 
providing a i^urality ^ viewers with an interactive television program comprising a phuality of signals related in time and content Video 
s gna^fi are ^nsmitted m a digital format, more than one rignal bebig multiplexed onto a date stream on a single channel Tbc video 
signals may be compressed fw efficiency. A receiver. In conjunction wift a signal selector, selects a particular NTSC channel for playback 
then selects a particular video signal from the date stream, and decompresses the video signal for jSaybacI:. Seamless switchbig between 
video signals on different channels is provided. An altemarive embodiment is disclosed wherein the various signals which comnrise the 
intciactive program are switched at the head end rather than al the receiver. The multiple choice contit>l unit selects a desired sl&nal by 
relaying the multiple choice flections of the user through a relay box back to a remotely located switeMng stetion. Ttie switeUna staticm 
routes the correct video signal down the appropriate cabte channel for the particular user. e « ^wiu^oing muion 
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COMPRESSED DIGITAL-DATA SEAMLESS VmEO SWITCHING SYSTEM 

CROSS-REFERENCE TO RELATED APPLICATIONS 
This application is a continuation-in-part of application Serial Number 
08/887.314, filed July 7, 1997, which is a continuation of application Serial Number 
08/443.607, filed May 18, 1995. now U.S. Pat No. 5.724.091, which is a 
continuation-in-part of application Serial Nuniber 08/166,608, filed December 13, 
1993. abandoned, which is a continuation of application Serial Number 07/797.298, 
filed November 25, 1991. abandoned. 

BACKGROUND OF THE INVENTION 

1. Field of the Invention 

The present invention relates generally to interactive response systems, and 
more particularly to an interactive television system which provides interactive 
programming using compressed, digital data having more than one video signal on a 
broadcast channel, or a multiplexed signal within a digital format, or both. 

The invention also relates to seamlessly switching between video signals while 
viewing a first video signal, even thou^ the video signal switched to may be on a 
diff(neta broadcast channel, or on the same channel multiplexed with, the currently 
viewed video signal. 

2. Description of the Prior Art 

Interactive systems are well known in the art. By synchronizing parallel tracks 
of an information storage media, and relatmg the content of the various tracks, it was 
found that interactive activity could be simulated. For example, commonly owned 
Freeman, U.S. Patent No. 3«947,972 discloses the use of a time synchronized multi- 
track audio tape to store educational ccmveisations. One track is employed to relay 
educational interrogatories to a user, and the remainder of the trades, selectable by a 
switching mechanism, are used to convey responsive messages. 

These systems progressed to interactive television, wherein multiple broadcast 
or cable chaimels were switched in response to user selections to provide interactive 
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operadoQ. Commonly owned Freeman, U.S. Patent No. 4,847,700 discloses an 
interactive television system wherein a common video signal is synched to a plurality 
of aiidio channels to provide content related to user selectable responses. 

Commonly owned Freeman, U.S. Patent No. 4,264,925 discloses the use of a 
conventional cable television system to develop an interactive system. Standard 
television channels with time synchronized content are broadcast to a plurality of 
users. Each user switches between channels responsive to Intenogatories to provide 
interactivity. 

These systems have been tailored to include memoiy functions so ttdX the 
system can be more interactive, individually responsive, and so that customized 
messages may be given to the various categories of users responsive to informational 
queries. Freeman, U.S. Patent No. 4,602,279 discloses the use of a memoiy to store 
demographic profiles of television viewers. This information is stored to be recalled 
later for providing target specific advertising, for example. Prior art interactive 
television systems were generally concerned ^mth providing one signal (i.e. one video 
signal) per channel, whether the channel Is on cable television, broadcast television, or 
a VCR. Becau.se cable and broadcast television channel ci^>acity is becoming limited 
as more and more cable channels are being utilized for conventional programming, 
and interactive systems of the type described require multiple channels, it is desirable 
to reduce the channel capacity' required for such systems while still providing at least 
the same level of interactivity. 

U.S. Patent No. 5,724,091 disclosed and claimed seamlessly switching 
between video signals while viewing a first video signal, even though the video signal 
switched to may be on a different broadcast channel, or on the same channel 
multiplexed with, the currently viewed video signal What is needed, however, is a 
less complex method and system for seamlessly switching between compressed digital 
video signals m a low cost digital set top environment 

SUMMARY OF THE INVENTION 

The present inventiod is a digital cable television system which utilizes digital 
video signals to provide customized viewing responsive to user selections. A 
standard cable or direct broadcast satellite television distribution network is utilized 
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for transmitting interactive and other progranuning to users. The present invention 
allows a plurality of viewers to be simultaneously provided with a plurality of 
different digitally compressed program signals. Further, interactive programs 
comprises a plurality of video signals. 

The video signals are converted into digital fomiat for transmission. In a 
digital format, it is possible to transmit more than one video signal per cable 
television channd. Further, it is possible to transmit video signals via convention^ 
telephone lines. If desired, the various digital video signals may be compressed 
before transmission. Compression allows an even larger number of video signals to 
be transmitted over a channel of the transmission media. Preferably, the compression 
scheme used is one of the MPEG standard compression schemes, including MPEG2, 
MPEG4 andMPEGT. The video signals are fed mto a digital data and video format, 
preferably in the KfPEG fonnat 

As part of the digital signal transmission, some of the signals are interactive 
and individualized programming. Such enhanced content is created by utilizing 
conventional video production techniques and by providing a multiplicity of video, 
audio, gr^hics and data in any combination thereof. The multiple video and audio 
information is time synchronized and, in most instances, pi^fenbly related in content. 
The subsequent interactions at the remote sites are controlled by the end use and 
producer, via the insertion of data codes representing a scripting language. These 
codes are preferably integrated and sent with the interactive video and audio signals 
and may be inserted either at a program control center or cable headend. 

An multiplexer combines the various digital signals into a reduced number of 
transmission data streams for transmission. The various NTSC television channels 
may be allocated m a predetenmned fashion to maximize the number of 
simultaneously transmittableagnals. The multiplexer in conjunction with the 
tdevision transmission system multiplexes the desired data streams onto the desired 
channels, and transmits these signals over the NTSC channels. The number of video 
signals which may be multiplexed onto a data stream on a single transmission channel 
will vary depending on the video signals to be transmitted. The television channels 
containing a data stream of multiplexed video signals may be transmitted over a 
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Standard cable television distribution network, or direct bioadcast satellite 
tiansnussiOD system. 

After encoding, compression, multiplexing and modulation, the program 
signals and interactive program signals are distributed by a transmission means 
including, but not limited to. satellite, cable television, fiber optics, public switched 
telq>hone network, tOTestdal broadcast, closed drcuit, etc., where the modulation 
technique is defined by the means of transport Additionally, the distributed content 
may include a signal conversion or letiansniission prior to receipt by the end users. 

The programs are received at an end usct's location and connected to the 
appropriate leceptioa device. Receptions devices, for example, may include* but are 
not Hmited to, cable television receivers/converters, satellite receivers, terrestrial 
broadcast rcceiveis. personal computers, etc.. The receiver receives one or more 
television channels, some or all containing a muldplcxed data stream of video signals 
or non-multiplexed digital video signals, and m conjunction with a signal selector, 
selects a particular data channel/ data stream for playback, then selects a particular 
video signal from the data stream's multiplexed signal, find finally expands the video 
signal, if necessary, for playback to a television monitor. 

The signal selectw may comprise a controller and software, for example, in a 
digital set top box. The controller and software in a digital set tap box operate to 
control the receiver and signal selector to select a particular digital video signal. 

A user inputs rcspoascs preferably via a standard remote device. The user may 
be simply changing from one digital channel to another or providing responses to an 
interactive program. In the mteractivc program embodiment, the user seleciably 
responds to information displays or interrogatory messages and the signal selector 
selects a particular multiplexed video signal and de-multiplexes, expands and displays 
the selected video signal. Alternatively, the signal selector may select a video signal 
based on personal profile information stored in memory. 

If more signals are needed for an interactive program than w^ mappable to a 
data stream on a single channel, the signal selector in conjunction with tiie receiver is 
programmed to switch between the various video signals within a multiplexed data 
stream as well as between data streams among the various broadcast channels to 
provide the necessary level of interactivity. 
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^ Hic various infonnation segments in Che various video signals preferably 

relate in real-time and content so that an interactive conversation can occur as the 
video signal is played back and the user responds to the various interrogatories on the 
video signals. The use of multiple signals per channel may be used for many types of 
5 interactive programs, including those disclosed in the previously mentioned U.S. 
Patents, for example, field synchronized multiple camera angles from a sporting 
event, or an interactive game show. However, the present invention also covets the 
use of various video signals not related in ceal-time and contrat 

In a two-way embodiment, the various signals ^^lich comprise the interactive 
JO program may be switched at the head end rather than at the receiver. This 
20 mbodixnent may be used in a cable television system, a direct broadcast satellite 

system, a conventional telephone system modified to receive digital video signals, or 
any other appropriate oransmission system capable of sending digital video signals. 
The multiple choice control unit, rather than the hand-held multiple choice controller, 
IS selectsadesircd video signal by relaying the multiple choice selections of the user 

through a relay box back to a remotely located switchmg station, preferably the cable 
television source. The multiple choice selections may be relayed to the switching 
30 station in any conventional means, such as two-way cable television, telephone, or FM 

uansmissjon. If the interactive programming is being transmitted over a telephone 
20 line, the noultiple choice selections may be relayed back over the same telephone line. 
The switching station receives the multiple choice selection of the user and routes the 
correct signal down the appropriate cable channel, telephone line, or other 
transmission media for the particular user. In such an airangement, only a single link 
is required between the subscriber or receiver and the head end so that the one channel 
40 25 link can be used to receive a plurality of different channel selections dependent on the 

interactive choice relayed from the receiver to the video switch at the head end. 

If desired, the two-way link may be used for other purposes, such as to 
uransmit user demographic dau back to the programming source for commercial 
reasons, or to allow an interactive game show player to win prizes, for example. 
30 Once a signal is demodulated, the digital data stream is demultiplexed into its 

constituent elements such as video, audio graphics and data. The demultiplexed 
^ digital data stream is directed to the appropriate decode devices, i.e., video to video 
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^ decoder, audio to audio decoder, graphics to display driver and control data to 

applications software. 

In the interactive program embodiments, the application software reads the 
^0 data and processes Ihe scripting language. Further, the interactive application 

5 softwaie processes input from the end user. Based upon a combination of inputs, it 
then decides upon the appropriate action. The viewing experience is then enhanced, 
based upon the indi^dualization of the content by switching among the video, audio, 

IS 

graphical and data elements. 

The system of the present invention allows inqnoved performance during 
10 switching, making the chamielsimti^ transparent Virtual channel ^icationis for 
20 enhanced inogramming and addressable advertising will need to enable frequent 

switching among multiple MPEG video streams. When a channel change is required 
by a user response to an interactive interiude. a slight imperceptible delay is 
programmed to allow the expansion algorithm an opportunity to adjust to the rapid 

25 

15 change from one video signal to another. 

During the delay, previously obtained video information is displayed while the 
interactive system locates, recdves, demultiplexes, decompresses, decodes, and 
30 processes the new video signal. This allows the interactive system to switch to the 

new video signal without flicker or distortion appearing on the TV screen, i.e., a 
20 seamless switch. 

Disclosed arc different methods to achieve this seamless switching. One 
involves an analog video frame buffer. Another uses two tuners. Other alternatives 
include: (a) using two digital video buffers; (b) using a large memory, (c) using a 
large buffer in an embodiment similar to that of (b); and (d) switching at the cable 
40 25 headend. 

The preset invention includes a preferred improved method and system for 
seamless swltcUng between MPEG compressed digital idgnals m a digital set top, 
HDTV or pers<mal computer oivironment. While the MPEG standard discusses the 
use of splice points, such points are difHcult to insert in video streams that come from 
30 different sources, which is the typical cable television environment This is because 
streams that have been compressed at separate times may have different clocks and 
50 therefore different timing information. By making some modifications on the encode 
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process for the virtual diannel applications, novel enhancements can be made to 
splicing. Sudi enhancement s of the present invention include locking the time bases 
of the multiple channel encoders, genlocking the video sources, time synchronizing 
the start of the encode process, and inserting splice points at the appropriate locations 
in the GOP. The present invention utilizing these consu^ints and others for various 
virtual channel appUcations has the significant advantage of requiring virtually no 
hardware changes to most conventional digital set top convertCTS. 

pRIEF DESCPnmON OF TH E DRAWINGS 
FIGURE 1 is a block diagram of the Interactive Television System of the 
present invention. 

FIGURE 2 is a block diagmm of the system of the present invention in a two- 
way transmission configuration. 

FIGURE 3 is a block diagram of one embodiment to achieve seamless 
switching between video signals. 

FIGURE 4 is a block diagram showing an alternative embodunent to achieve 
seamless switching between video signals. 

FIGURE 5 is a block diagram of an embodim^ of a central progranmung 
location. 

FIGURE 6 is a block diagram showmg video splice points and tune gaps m 
the video programming streams. 

FIGURE 7 is block diagram of an alternative embodiment of a reception box. 

FIGURE 8 is a block diagram of alternative audio frames. 

FIGURE 9 is a block diagram of a TV broadcast station switcher. 

FIGURE 10 is a block diagram of an embodim«it for Non-related Program 
Switching. 

FIGURE 1 1 is a block diagram of an embodiment for S Witchhig within 
Multiple Event Prognunming. 

RGURE 12 is a block diagram of an embodiment for Seamless Pictuic-in- 

Picture Program Switching. 

FIGURE 13 is a block diagram of an embodunent for Switching within 
Multiple Commerce/Shopping Programming. 
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FIGURE 14 is a block diagram of an embodiment for Digi^ 
Itisection — Addressable Advertising. 

FIGURE 15 is a block diagram of an embodiment for Seamless Switching 
fix>m a Group of Signals to Other Signals at a Server. 

FIGURES 16A and 16B are block diagrams of an alternative Two-Tuner 
Embodiment 

FIGURE 17 is a block diagram of an alternative Two-Tuner Embodiment 



nKSCMFnON OFTHE PREFERRED EMBODIMENT 
The present invention Is an interactive television system m which a plurality of 
viewers are simultaneously provided with a plurality of different program infonnadon 
message signals. A plurality of video signals 1 are provided. Video signals 1 may be, 
for example, various field and/or audio synchronized camera angles of a sporting 
event, or a game show having a content and host acting responsively to user 
selections. Alternatively, video signals 1 may be any video signals suitable for 
interactive conversation, sudi as those described in U.S. Patent Nos. 4,847,700, 
3,947,972, 4,602,279, 4,264,925, or 4,264,924, the contents of which are mcoiporated 
specifically herdn by reference. Various ^pes of time and content related video 
signals exist wtuch are suitable for interactive operation. 

In previous systems, these various signals would be transmitted to a receiver 
on separate broadcast or cable channels, each requiring a separate 6 MHZ NTSC 
channel. According to the present invention, video signals 1 are directed to analog-to- 
digital ("A/D") converters 2 which convert the varioas video signals into digital 
format for transmission. AJD convenors 2 may be of any conventional type for 
converting analog signals to digital fomoat An A/Dconvertor may not be needed for 
each Video signal 1, but rather fewer converters, or even a single convertor are 
cq)able of digitizing various video signals 1 . Interactive video programs may also be 
delivered to a cable or other distribution network in pre-digitized and/or 
precomprcssed format. 

Digital conversion results in very large amounts of data. It may therefore be 
desirable to reduce the amount of data to be sent, allowing moxe signals to be sent 

8 
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over a single transmission channel. For example, a single frame of digitized NTSC 
video represents over 350 Kbytes of data. Therefore, two hours of standard video is 
about 80 Gbytcs. Since there are 30 frames/see in such video, the data transfer rate is 
22 Mbytes/sec. This large amount of data is preferably reduced by digital 
compression. 

In order to reduce the data transfer requirements. Use various digital video 
signals are preferably compressed before transmission. The video may be compressed 
by any conv«itional compression alg<xithm, the two most common types being 
"processor intensive* and "memoiy intensive." 

The processor mtensive i^roadi perfoims compressioQ by eliminating non- 
changing aspects of a picture from the processing in the frame*to>frame transfer of 
information, and through other manipulations of picture information involving 
mathematical confutations that determine the degree to which a given motion in a 
picture is perceptible to the human eye. This approach depends on high-speed 
processing power at the transmission point 

The memory approach involves division of a picture frame into hundreds of 
minuscule blocks of pixels, where eadb block is given a code representing its set of 
colors and variations in luminance. The code, which is a mudi smaller increm^t of 
infonnation than all the infonnation that would describe a given block of the picture, 
is transmined to the receiver. There, it calls up the identically coded block from a 
library of blocks stored in the mcmoiy of the receiver. 

Thus, the bit stream represents a much smaller portion of the picture 
infonnation in this approach. This system is generally limited by the variety of 
picture blocks which may be stored in the receiver, which relates directly to memory 
size and miooprocessor power. 

Examples of commonly known compression techniques which may be used 
with the invention are JPEG, MFEGl and MPEG2. 

Data Compressors 3 are provided to reduce the data for each video signal 
which must be transmitted Data compressors 3 may be of any conventional type 
commonly known in the art for compressing video images, such as those previoasly 
described. Compression of the various video signals might be done with fewer data 
compressors 3 than one compressor per video signal. In a conventional analog NTSC 
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sysiem, by way of example, it is customary to transmit one video signal per 6 MHZ 
channel. By digitizing the video signal, it is possible to send a data stream containing 
more than one video signal in one diannel. Compressing the digitized signals, allows 
even more video signals to be transmitted over a single transmission channel The 
number of signals which may be sent over a single channel is generally related to, for 
example, a) the type of video being sent; b) the video compression scheme in use; c) 
the processor used and memory power, and d) the bandwidth of the transmission 
channel. 

Coiiq>resslon techniques exploit the feet that in moving images there is veiy 
little change from frame^o-firame. Editing out the itdundandes between frames and 
coding just die changes allows mudi hi^r compression rates. The type of video 
which normally contams a great deal of lugh-speed movement, such as occurs at live 
sporting events, will, therefore, have the lowest compression rates. Movies, on the 
other hand, which normally have a lower frame rate and less frame-to-frame change 
than a live sporting event will achieve higher compression rates. Currently, 
commonly known compression schemes have compression rales that vary from 2:1 to 
10: 1 for satellites, and 2: 1 to 5: 1 for cable television systems, depending on the degree 
of motion* 

Once die various video signals I have been digitized and compressed, 
mtiltiplexer 4 combmes the various digital signals into a reduced number of 
(ransmission data streams for transmis^on. Fbr example, if 68 NTSC channels are 
available, and each channel is capable of transmitting either 4 digitized, compressed 
slow moving video signals (e.g. movies) or 2 digitized, compressed, high-speed video 
signals (e.g. sports), then the various NTSC channels should be allocated in a 
predeteimined fashion to maximize the number of simultaneously transmittable 
signals. 

As an example, the broadcast frequency corresponding to a first NTSC 
channd may contaui a data stream of separate digitally compressed non-mteracti ve 
mo^es. On this frequency, the data stream would contain video signals representing 
a number of movies. However, the video signals, unlike those of an interactive 
progtam, are not related in time and content. The frequency corresponding to a 
second channel might contain a digital data stream of an interactive sports program. 
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conasting of two multiplexed caiH)iesscd high-speed video signals that aic preferably 
related in time and content. The frequency conesponding to a third channel might 
contain a digital dau stream of an interactive movie consisting of four multiplexed 
compressed video signals which are related in time and content. The frequency 
corresponding to a fourth channel might contain an analog NTSC signal relating to 
local programming. Therefore, using the invention, four NTSC channels could 
contain a channel of multiplexed movies, an interactive sports program, an interactive 
movie, and local programming. 

Multiplexer 4 receives die incoming con^ressed, digitized video signals and 
in a predetenmnod conventional fashion, in conjunction wltii transmitter 5, 
multiplexes the defied video signal onto the defied channels* and transmits these 
signals over the NTSC channek. Certmn NTSC channels may contain only one video 
or otiier signal, in analog or digital form. 

As indicated earlier, the number of video signals which may be multiplexed 
onto a data stream on a single transmission channel will vary. Also, the number of 
channels which use data streams may vary. The transmission data streams are 
transmitted by transmitter 4 via traasmission media 6 to a receiving station 7. The 
transmitter 4. media 6, and receiver 7 may be any conventional means for transmitting 
digital video signals including broadcast television, cable television, direct broadcast 
satdlite, fiber optic, or any other Uansnussion means. Alternatively, the invention 
may be self-contained in a stand-alone system, as explained below. 

The transmission means may also be a telephone system transmitting a digital 
video data stream. Thus, a multiplexed data stream containing several broadcast 
channels or an interactive program with related video signals may be sent directiy to a 
user over a single telephone line. The aforementioned digital transmission devices 
may include means for transmitting analog signals as well. 

in one of the prefened emixxliments, the digital transmission signal is 
transmitted using a cable television systenu Receiver 7 receives various NTSC 
channels, some or all containing multiplexed or non-multiplexed digital video signals. 
Oidinarily, more than one channel will be transmitted by ttansmitter 5 and received by 
receiver 7 as in an ordinary cable television system. However, each of the different 
channels may have a data stream containing several digitized video signals tiiereon. 
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Therefore, receiver 7 preferably operates in conjanction with signai selector 8 to select 
a particular NTSC channel for playback, then to select a parUcular video signal from 
the data stream's multiplexed signal, and finally to uncompress or expand the 
compressed video signal, if necessary for playback to monitor 10. 

Multiple choice controller 9 operates to control receiver 7 and signal selector 8 
to select a particular video signal for playback. In practice, a user need not know that 
multiple signals per channel are in use. If, for example, 68 channels with 4 signals- 
per-channd were in use, conuoller 9, in conjunction with receiver 7 and signal 
sdector 8 might be pcogrammed to represent these channels to the user a.<schannds 1- 
2-72. Monitor 10 may be, for example, a convehtionai television. Signal selector 8 
preferably inchides a conventional de-multiplexer for selecting a particular video 
signal from the data stream on the channel currcnUy being received by receiver 7. 
Signal selector 8 further includes the necessary un-compression or expansion 
qyparatus corresponding with the compression scheme in use by compressors 3. 

In practice, an interactive sporting event program might be transmitted on a 6 
MHZ cable television signal using a compression-multiplexing scheme ^ch allows 
two sports video signals (A and B, for exan^le) to be transmitted over a single NTSC 
channel (channel 34, for example), tt might be desired to have four video signals (A- 
D, for example) for the particular interactive sporting event. A first video signal 
(signal A) may contain the standard broadcast signal of the game; the second video 
signal (signal B) may contain a close-up view of the game action; a third video signal 
(signal Q may contain a continuously updated replay of game highlights; the fourth 
video signal (signal D) may contain statistical information. These four video signals 
(A-D) may, for example, be multiplexed as follows; video signals A and B 
multiplexed onto a data stream transmitted on cable channel 34; video signals C and 
D multiplexed onto data stream transmitted on cable channel 35. Alternatively, all 
four video signals (A-D) could be multiplexed into one data stream carried on one 
frequency channel. These four signals may, however, be mapped by controller 9, or 
signal selector 8, to play as separate channel displays for the user which, when the 
viewer makes choices on the multiple choice controller, a seamless switch occurs 
therebetween. Each video signal of this interactive program may include a label 
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which reads, for example, *'Full-Screen Action - Press A: Qose-up Action - Press 
B: Replay - Press C: Statistics - Press D." 

As shown, if more signals were needed for an interactive program than were 
mai^pable to a data stream on a single channel, signal selector 8 in conjmiction with 
receiver 7 may be programmed to switch between the various video signals 1 as well 
as the various broadcast charmels to provide the necessary level of interactivity. 
However, preferably all the various video signals associated with a particular 
interactive program are multiplexed onto a single cbamiei. 

Additionally, the signal selector 8 may store information relating to current 
and previous user responses. For exanqile, the personal profile of the viewer or 
previous response patterns of the viewer could be stored in memory. TOs information 
may be used in conjunction with commands transmitted within the video signals, as 
discussed in patent No. 4,602,279, incoiporated herein by reference. The stored 
personal profile information and received commands may be used to switch 
interactively between data streams and video signals without any additional response 
from the user. 

The multq}lexed interactive program m^ be transmitted over a single 
telephone line, if desired. In this embodiment, multiple choice controller 9 is 
progranmied to switch between the various video signals on the single telephone line. 
If additional chaimels were desired, a two-way configuration is used as described 
below. 

The system of the present invention may be utilized in an educational 
embodiment In this embodiment, Information is stored on each data stream in a 
plurality of reproducible information segments, each of which comprises a conq>lctc 
noessage reproducible by the receiver directly in response to the selection of the video . 
signal by signal selector 8 responsive to a user selection on multiple choice controller 
9. Each of the information segments in the various data streams contain interrogatory 
messages with associated multiple choice responses, responsive messages, 
informational messages, or combinations thereof. 

The various information segments in the various data streams preferably relate 
in real-time and content so that an interactive conversation may occur as the video 
signals are displayed and the user responds to the various interrogatories contained in 
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the video signals. As a user answers a particular intenogatory with a mulUple choice 
response, the mformation in the video signal associated with the particular selection is 
displayed by the signal selector 7. The various interrogatories, responsive messages, 
and informational messages may generally be contained in any one. more than one or 
all of Che various video signals. 

The use of a data stream containing multiple video signals per broadcast 
channel may be used for many typts of interactive programs, such as those disclosed 
in the previously mentioned VS. patents. Other interactive programs may be 
developed which are within the scope of die pnscm inv^tion. 

The present invention may also be utilized as a stand-alone system with no 
transmission means necessary. In this embodiment, the digitized video signals that 
make up an interactive program are stored in local storage means such as video tape, 
video disk, memory (e.g., RAM. ROM, EPROM, etc.) or in a computer. Preferably, 
the digital video signals are multiplexed onto a standard NTSC signal. The parUcular 
storage means may be connected to any of the interactive boxes disclosed in Figures 
3-5, and described below. The interactive boxes would then be connected to a 
television set. Alternatively, the circuitry in Figures 3-5 below could be implemented 
on a board and inserted into a standard personal coiiq)uter(PQ. Aseparate 
microprocessor on the interactive board is not necessary for this configuration since 
the standard PC processor performs the functions of the processor 108 shown in 
Figures 3-5. 

As shown in HO. 2, the system of the present invention may be operated in a 
two-way configuration. In this mode, the various video signals 1 are processed as 
previously described, being digitized by A/D convertor 2 and compressed by video 
conqiressors 3. The signals are tiien routed to a central switching station 14, In this 
embodiment, the switdiing between the various video signals is accomplished at tiie 
head end rather than at die receiver. Multiple choice control unit 9 relays Uie multiple 
choice selections of tiie user tiirough a relay box 17 back to the remotely located 
switching station 14. The multiple choice selections may be relayed by relay box 17 
to the switching station by any convwitional means, such as two-way cable television, 
telephone, or FM transmission. Switching station 14 receives die multiple choice 
selection of die user and routes tiie desired signal to transmitter 5 which 
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conventionally transmits the desired video signal down the appropriate cable channel 
for the particular user. If desired, transmitter 5 may also transfer conventional 
programming on the cable television channels not being used for interactive 
programming. Alternatively, switching station 4 may include multiplexing equipment 
as previously described, and thus operate multiple interactive or noninteractive 
programs over a single television channel. 

For example, if it were desired to implement the interactive football game 
program as previously described, a single NTSC cable channel may be allocated for 
the program. However, in this instance* the video signals would be present at the 
transmitting end. In response to a signal from wireless controller 9, a signal is sent by 
relay box 7 to the cable TV switching station which routes the desired video signal to 
die requesting viewer. Such a system requires very Cast switching equipment, but can 
be implemented using digital imageiy. 

Alternatively, it may be desirable to transmit the interactive sporting event 
over a single telephone line. When the user raters a selection on controller 9, a signal 
is sent via the telephone line to the central switching station which routes the desired 
signal of the interactive program over the user's telephone line so that a single link 
handles both the interactive choice being made at the receiver and tiic transmission of 
that choice, out of a plurality of choices, from the head end where the actual switching 
takes place in response to the interactive selection made at the receiver. 

The two-way link between the user and the switching station may be used for 
other puiposes. For example, demographic data may be transfraed from the user to 
the broadcast network for commercial purposes, such as targeted advertising, billing, 
sending a game show winner a winning number for pickup of a prize, or oUier 
commercial or non-commeicial puiposes. 

As previously described, compression systems generally perform less 
efficiendy when frame-to-fiame content includes many changes in pixel content (e.g., 
during fast motion or scenery changes). The system of tiie present invention may be 
advantageously programmed to case the processing burden on tiie uncomprcssion 
program. When a key on the controller is depressed to select a desired signal, a slight 
imperceptible delay may be effectuated if desired. This delay allows the un- 
compression or expansion algoritiim a short period of time to adjust to die rapid 
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change from one video signal to another which ordinarily causes a degradation in Che 
efficiency of the algorithm causing video glitches to appear on the screen display. 

As shown in Figure 7, a two way link (similar to Figure 2) may also be used, 
employing virtual channels back to the user. In this embodiment, multiple video 
signals, prefmhiy related in time and synchronous to each other, are present at a 
cable headend 300 on multiple channels A, B, C, . . . N of a video signal bus 250. The 
signals m^^ be locally generated or received from a remote location (such as a 
spotting arena) by receivers 200. 202, 204, and 206. Alternatively, if the remotely 
received signals are digitally multiplexed onto one channel, a digital demultiplexer 
would replace receivers 200-206 and would demultiplex the signals and place each 
signal on a separate bus channel. The local or remote signals are synchronized by 
sync circuit 208. A number of remote control interactive switches 210, 212, 5l4, 216, 
and 218 arc connected to video signal bus 250. The multiple channels on bus 250 arc 
provided synchronously and simultaneously to the series of remote control interactive 
switches 210, 212, 214, 216, 218. These remote control interactive switches are 
dynamicaUyaUocated to users who request access to an interactive program. Each 
switch is connected to a frequency agile modulator 220, 222, 224, 226, 228 to assign 
the switch a vutual diannel in order to connect a signal from bus 250 to a speciGc 
user at a remote site. Each switch is assigned to a single user so the number of 
switches present at the headend is the limiting factor to the number of uscn who can 
interact simultaneously. If it is assumed that only a portion of the users will interact 
simultaneously, an algorithm is used to dctennine the optimum number of remote 
switches necessary to assure an acceptable percentage of access. 

After passing through the frequency agile modulators 220, 222, 224, 226. 228, 
the signals from video signal bus 250 progress through the cable (or broadcast TV) 
system 260. The signals may pass tfarougli RF feed 262 and an^lifler 230. The user's 
set top box 232, 234, 236, contaimng a frequency agile demodulator, is tuned to the 
frequency of the associated frequency agile modulator 220, 222, 224, 226. 228. Hie 
decoded signal from the set top box 232, 234, 236 is displayed on television monitor 
la 

When a user desires to interact, the user issues a command on the controller 9. 
The conunand is received by the set top box 232, 234. 236. A user request is sent 
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back down the cable or other transmission system 260 to one of the remote switches 
210, 212, 214, 216, 218. At the appropriate time, based on the user request and the 
algorithm for mteractivi^ which accompanies the program, the remote switch makes 
a cut during a vertical blanking interval firom one signal on bus 2S0 to another signal 
on bus 250. The result of this switch is modulated by one of the fiequency agile 
modulators 220* 222, 224, 226, 228 and sent down the vutual channel to the user, who 
sees a seamless cut from one image to the other as a lesult of the interaction. The 
signal delivered to the user may be fall bandwidth or compiessed video. IJkewi<» the 
video signal on the bus 250 deliv«ing the simultaneous signal to the multiple lemote 
switches 210, 212, 214, 216, 218 naay be compressed video. This embodiment allows 
for a relatively low cost remote user box because the most costly switching equipment 
is located at the headend and each remote switch may be allocated to any user. 
Therefore, the cost is spread over the larger population of users. 

As an example, it is assumed that the signal received by receiver 206 is placed 
on bus line 270 of the video signal bus 250 and Is forwarded to set top box 236 and 
displayed on monitor 10. At some point the set top box 236 causes a user request to 
begenerated. Theuserrequestisbasedonacuirratorpastentiy oncontroUer9 
and/or information stored in set top box 236 (e.g., mformation stored could be 
previous user response information or personal profile information). The cable TV 
system 260 may amplify the user request at amplifier 230 while carrying the user 
request back to frequency agile modulator 226, which communicates the request to 
remote switch 216. During the vertical blanking interval, the remote switch 216 
disconnects firom old bus line 270 and switches to the appropriate line on the video 
signal bus 250, in this example line 280, based on the user request. This is shown by 
the dotted-line connection at 290, The signal from the new connection (received by 
receiver 204) is sent throu^ the frequency a^e modulator 226 on channel 47 and the 
cable TV system 260 to the user's set top box 236. The new signal is seamlessly 
displayed on television monitor 10, without any switching occurring at set top box 
236. 

As alternatives to the cable headend 300 and cable TV 260 of Figure 7, a 
telephone central office and/or telephone lines may be used. This alternative would 
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allow the set tops 232, 234. 236 to leceive interactive programming fix>m a telephone 
company or cable headend via telephonic communication. 

Figures 3, 4, 7, 16 and 1 7 show preferred embodiments of the receiver 7 and 
signal selector 8 of the present invention to enable seamless flicker-free transparent 
switching becwe^i the digital video signals on the same channel or different channels. 
These embodiments may be connected to any transmission media or singly connected 
to die ouqyut of any stand-alone storage means for the rfjgjjHzrfd multiplexed 
intenu^tiveprograoL Preferably, the receiver 7 and dgnal selector 8 are both 
components of an mtoiactive program box 1 1, which connects to a television or other 
display monitor. Alternatively, the required functionality of the RF receiver 7, signal 
selector 8 and monitor could all be combined in a standard personal computer by the 
addition of a few components to the personal computer. To provide this capability, 
only an RF demodulator board, digital demultiplexer, dccompressor(s). frame 
bufferCs), and sync components need to be added to the personal computer. These 
items, and any other OHnponents, may be connected to the PC processor and storage 
demeatsasdisdosedjnIigures3,4,7, 16andl7. In this embodiment, tiie os^* 
makes selections via the computer keyboard. 

Figure 3 shows an embodiment with a single analog frame buffer. Figure4 
includes pans of RF demodulators, error correctors, and demultiplexers and/or a pair 
of digital video buffers, as described below. 

Figure 3 shows an embodiment which allows for a seamless video switch 
between two or more separate digital video signals. As shown in Figure 3, a 
microprocessor 108 is connected to RF demodulator 102 and digital demultiplexer 
106. The microprocessor 108 directs demodulation and demultiplexing of the proper 
channd and data stream to obtain the correct video signal. The proper channel is 
determined either by examination of the user's input from user int^ace 130 and/br 
any other information or criteria (such as personal profile information) stored in 
RAM/ROM 120. For example, the RAM/ROM 120 could store eommands provided 
within the video signals as discussed in patent No. 4,602,279, and incorporated hemn 
by reference. The user interface 1 30 may be an infrared, wireless, or wired receiver 
that receives information from multiple choice control unit 9. 
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The RF demodulator 102 is part of the receiver 7, and demodulates data from 
the broadcast channeJ directed by the microprocessor 108. After the data stream is 
demodulated, it passes through a forwaid error correction circuit 104 into a digital 
demultiplexer 106. The demultiplexer 106 is controlled by microprocessor 108 to 
provide specific video, audio and data signal out of a number of video; audio and data 
signals located within the data stream and steer them to the appropriate device for use 
within the system. In order to seamless splice firom one video stream to the other it is 
piefmed to perfonn the switdi in the digitally compressed domain thereby 
eliminatmg the need to decode two video audio and data streams at the same time. 

When the compressed digital video is sent to the video decode function it is 
first stored in memory 160 until there is enough information buffered to ensure 
continuous playback of the video stream. Because of the compressed nature of the 
video infonnation. a relatively small buffer 160 can hold a significant amount of video 
information (on the average of five to sbc frames). This means that there is a 
significant delay from the tune the compressed video is received to the time it is 
decompxessed and played out. Therefore, the preferred method for switching in the 
set top would be to select the new video on the way into the video buffer 160 while 
continuing to play out the old video to the monitor. Because the incoming stream has 
been created by producing syntactically correct MPEG segments that are sliceable, 
this can be achieved easily. By this method there is no need for additional hardware 
in the receiver. A video always appears to the viewer to be a single video stream with 
no repeated or dropped frames. 

MPEG allows for the reconstruction of the video dock at the receiver 1 1 
through use of a data field called the PGR (Program Qock Reference). This is 
necessary to ^ute that the decoder can play out the decoded video at the same rate as 
it was input to avoid dropping or repeating frames. Additional embedded information 
in the MPEG stream includes the PTS (presentation time stamp) and DTS Display 
Time Stamp. These signals are used to maintain lip synchronization with the audio 
and also to inform the receiver when to present tiie video and audio to the display. 

Figure 4 shows an alternate, dual tuner embodiment for seamless switching 
between separate video signals. In this embodiment, the microprocessor 108 controls 
the selection of tiie RF channel Uiat is demodulated by RF demodulators 102A. 102B , 
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The demodulated daU streams enter the forward error correctors 104A, 104B. At the 
output of the forward error correctors, the data streams are transmitted to the input of 
the digital demultiplexers 106A, 106B. 

As with the RF demodulators 102A, 102B, the digital demultiplexers 106A, 
106B are controUed by the microprocessor 108. This configuratioD allows the 
micrc^ocessor 108 to independently select two dififerent individual time-multiplexed 
video signals on different channels and data streams. If all the video signals of an 
intmcti ve program wctt contained on a shigle channel or data stream, it would only 
be necessary to have a single RF demodulator, forward error corrector, and digital 
demultiplexer seriaDy connected and feeding into the two digital video buffers. 

Two data streams are provided from the digital demultiplexers 106A and 
106B. The ou4>ut of the demultiplexers contain a multiplicity of video, audio and 
dat& that can now be directed to the appropriate device under microprocessor 108 
control In this way it is no longer necessary to have all of the information contained 
InoneRPdianneL Instead the information can be found at different frequ^des in 
the RF spectrum and we will still be able to splice among the streams. Byplacinga 
simply digital switch at the output of the two demultiplexers we can avoid duplicating 
the entire decode chain. It should be noted that this is only a cost saving approach and 
duplication of the rest of the chain would work as well. 

A standard MPEG stream contains different types of encoded frames. There 
are 1 frames (Inuacoded), P frames (Predicated) and B frames (Bi-diiectionally 
predicted). A standard MPEG stnicture is known as a GOP (group of pictures). 
GOP'susuaUy start with I frames and can end with P or Bftames. There is generally 
only one I frame per GOP, but many P and B frames. While it is not necessary to 
have any I fimnest they are useful for many reasons. 

GOP's that end with B frames are considered open. OOP's that end with P 
frames are considered closed. For the present invention, preferable code is closed 
GOP*s to ensure that there are no motion vectors pointing to frames that arc outside of 
the current GOP. 

MPEG also reorders the video frames from their original display order during 
the encode process in order to code the video more efficienUy. This reorder must be 
imdone in the decoder in order for the video to present properly. 
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Frame Order 1 2 3 4 5 6 7 8 9 10 U 12 iJ 14 15 16 17 18 19 20 

Frame Type IBBPBBPBBP I B BPB BP B B P 

TVpjcal 

FramcRcorder 1 4 2 3 7 5 6 10 8 9 11 14 12 13 17 15 16 20 18 19 

Transmis&ion 
Onder 

FramelVpe IPBBPBBPBB I P BBP BB P B B 
GOPl G0P2 
Spaces occur at the end of the B frame at the end of GOP 1 prior to the I frame 
of GOP2. It is important to point out that with appropriate controls the encoder can 
code with variable GOP length and place splice frames accurately to achieve the 
desiie interactive effect If the content is unrelated then the encoder can splice at the 
end of every GOP allowing for a multiplicity of switching qyportunities. Because die 
GOP ends on a P frame, a closed GOP is yielded 

Improved Seamless Switching in a Distal Syst&m 

Any of the above-described recq)tion unit embodiments can be used to handle 
the seamless switching of the present invention. In the piefened embodiment, 
however, seamless video switching at the reception units is enhanced through certain 
novd modifications to the encoding process. 

As set forth above, seamless switching between digital video signals, whether 
representing independent television programs or difiercnt related signals withm one 
interactive program, is cridcal to the viewing experience Seamless switdiing is 
defined as video stream switching that docs not produce visible artifru:ts. The effect 
of the encoding process is to simplify and enhance the seamless switching process. 

Hie encoding process is performed at a central location, the elements of wtuch 
are shown in Figure 5. As seen in Figure 5, a plurality of video signals 300 are shown 
which could comprise live or prerecorded video sttcams. The origin of the video 
signals could be from cameras for live video, video servers, video tape decks, DVD, 
satellite feed, etc. The video signals can be in MPEG format* HDTV, PAU etc.. A 
plurality of audio signals 308 may originate from CD, tape, microphones, etc.. 
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The data codes, shown emanating from the data code computer 3 16 in Figure 
5, are tfie interactive commands for interactive processing used by the set top 
converter, as discussed above. Preferably, the data codes arc part of an interactive 
scripting language, such as the ACTV scripting language, originating in a coding 
coiqmter3i6. The data codes are also forwarded to the encoder 3 12. These data 
codes facilitate the multiple interactive programming options at the reception units. 
This embodiment requires a data channel for enabling a synchronous switch between 
a first video stream and a second video streant This data channel comprises the codes 
which link together the different program elements and infonnation segments on the 
different video signals. 

Referring agam to the video signals 300, the plurality of video signals 300 ate 
genlocked in the video genlock device 304 and thus, time synchfx>ni2ed The time 
synchronized video signals are directed into the video and audio encoder 312, hi the 
preferred embodiment, compatible encoders 3 12 are required at the cable headend to 
work with the digital reception units at the remote sites. The mteractive i^iications 
of the current invention are preferably fadlitated by synchronizing tfie commands at 
the headend to a spedfic video Irame and a specific audio fiame. Thislevdof 
synchronization is achievable wthin the ^tax of the MPEO-2. 4or7 specifications. 

In order to facilitate the seamless switch at the leoepdon sites, the video 
encoders 312 are preferably time synchronized. This synchronized start is necessary 
to ensure that the splice points that have been placed in the video content occur at the 
correct frame number. While it is not necessary to obtain this level of accuracy for all 
program types, it is achievable in this manner. This provides content producere with 
the ability to plan video switch occurrences on a frame boundary withm the resolution 
oftilie Group of Pictures (OOP). SMPIE time code or Vmical Time Code (VTC) 
information can be used to synchronize the encoders 312. Additionally, a splice can 
be placed accurately at any fnune by utiliziii^ the variable loigtb GOP. Upon 
command from an extwnal controlling device such as the ACTV command code 
computer 3 16, the encoder 3 1 2 can be directed to msert a splice at an fame number. 
Making encoder modifications at the headend ensures mote effective seamless 
switching at the set top converters. 
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As shown in Figure 5, multiple video signals 300, data codes 3 16 and audio 
signals 308 are input into the encode 312. In the preferred embodiment, four video 
channels are input into tl^ encoder 3 12. However, more or less video streams may be 
iiqmt based on the content Chat is to be deUveied. In the current environment, 
practical limitations for the number of videos ait based on picture quality. 
Ultimately, however, there wiU be no limit to the number of videos and audios that 
can be contained withm a single channel. FMer, all current limitations can be 
removed through the use of the altmate cmbodhnent that describes a two tuner 
implementation. 

Preferably, the encoder 312 uses a standard MPEG-2 compression format 
However, MPEG-4 and MPEG-7 as well as other compression formats, such as 
wavletts and firactles could be utilized for compression. These techniques are 
compatible with the existing ATSC and DVB standards for digital video systems. 
Cferlain modifications, however, are made to the MPEG stream in order to facilitate 
the preferred seamless switching at the set top box. These modifications to ttie 
aicoding scheme are described bdow with reference to the video frame structure 332 
shown ia Figure 6. 

Switches at the remote reception sites will occur at the video splice point 336. 
Program switching is facilitated through the provision of splice points. The splice 
points arc identified within the program stream via the adaptation field data. Program 
swtching occurs at these points based on user inputs, personal profile informaUon 
stored in memory at eitficr the set top converter or the headend, and commands from 
the program source. 

With respect to creation of the video spUce pomt 336, the video encoder 
insCTts splice pomts at every Group of Pictures (GOP), as diown m Figure 6. A COP 
consists of generally one I frame and a series of P and B frames, based on parameters 
set within the MPEG scheme. Preferably, the GOP is encoded as a "closed" GOP 
structure, which means that the GOP concludes on a P frame. Therefore, no motion 
vectors to the next GOP are present. If motion vectors cross from one GOP to the 
next GOP, artifacts arc created and visible when the screen is switched Thus, a 
closed GOP structure is necessary for compliance with MPEG syntax and to ensure 
the absence of visible artifacts after execution of the splice. 
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The GOP length is programmable and can be within 1 to infinite frames of 
video. It is prcfcned. however, that the GOP comprise 10-15 videp frames. Referring 
to Figure 6, four video signals are shown. It is desired that a seamless switch be made 
from any video signal to any other video signal. 

As shown in Figure 6, seamless video switching occurs on a GOP video-frame 
boundary* For pre-recorded material, splice points need to be identified for switch 
points. For programming where •fee" channel selection is requked (e.g., sports), all 
GOP boundaries are encoded as splice points. While the switch must appear 
seamless, it need not occur Immediately. For exan^le, a command or key input 
requires a finite time for processmg. Therefore, a video switch may be delayed by up 
to 1.5 OOP's. 

As shown in Figure 6, splices take advantage of the non real time nature of 
MPEG data during Oransmission through the digital channel to create a time gap 340 
in which the decoder can be switched from decoding one stream to decoding the other 
during the gap 340. Thus, the gaps 340 shown in Figure 6 represent the switch times. 
The key is that the most con^lex video is completed and through the channel before 
&e first packet of the next GOP is througjiflie channel. By encoding at a lower bit 
rate than the channel capadly, some extra tune is created at the end of the GOP in 
order to switch. In this way, two MPEG sUcams are merged to create a single 
syntactical correct MPEG data stream. These gaps can be created at the encoder 3 12, 
shown in Hgure 5, using any conq>ression scheme. 

The audio signals, preferably, are encoded using the AC3 format The present 
inventton, however, covers any conventional audio encoding scheme. 

All of the various video, audio and data signals are digitized and combined in 
the oicoder 312, in Rgure 5. Preferably, the conqn:tssed and encoded signal is output 
in DS3, Digital High Speed Expansion Interface (DHEI) or any other conventional 
fonnat. The data Qpe is not important, it is just data. The encode process then 
outputs a digital data stream at the appropriate bit rate for the target channel. 

The modulator 320 may utilize one of several different possible modulation 
schemes. Preferably, 64<JAM is chosen as the modulation scheme. If so. the data 
rate at the output of the modulator 320 is around 29.26 Mbps. However, any of the 
following modulation schemes, with respective approxinaate data rales, or any other 
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conveatioaal modulation scheme (such as FSK, n-PSK, etc.) can be used with the 
present invention. 



Separate NTSC channels are then combined in a conventional combiner, 
preferably using frequency modulation. Thus* seamless switching at the set top 
converters can occur from one signal to another within one NTSC channel or from 
one NTSC channel to another NTSC channel, as discussed below. 

In sununaty, seamless switdung at the decoder is facilitated at the encoder 312 
by time synchronizing the signals, time locldng the encoders and creating a time 
gq) 340 to each of the digital video streams (whidi represents the difference between 
the encode rate and the channel capaci^) to GOP^ defined below. 

After encoding, modulation and multiplexing, the signals can be transmitted to 
reception sites via satellite, wireless, land line, broadcast, or any other conventional 
transmission system. In the preferred embodiment, the signals are distributed to 
remote sites via cable or other transmission media. 

Reception Sites 

At the reception sites, preferaUy consisting of the elements shown in Figure 7, 
the signal is received via a tuner mechanism 344. The tuner 344 may be a wideband 
tun^, in the case of satdlite distribution, a narrow band tunex for standard MP£G 
signals, or two or more tuners for seamlessly switching between diftont signals 
located in different frequency channels, as explained below. In the case of MPEG 
signals, the tuner 344 tunes to the particular NTSC dianncl indicated from command 
by the host processor 360. The host processor 360 is preferably a Motorola 6833 1 
processor, but may be any conventional processor including PowerPC. Intel Pentium, 
etc. 

The signal is then forwarded to the demodulator 364. The demodulor 364 
demodulates the combmed signal, strips off the FEC and forwards the digital signals 



Modulation Scheme 



Rate 



256-QAM 
8VSB 

64QAMPAL 
256QAMPAL 



40 Mbps 
19.3 Mbps 
42 Mbps 
56 Mbps 



29.96 Mbps 
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to the video and audio decoder 372. At the digital decoder 372, the signals are 
separated and decompressed. The decoder 372 strips off the program identification 
number (PID), and routes these ?JDs to the appropriate decoder, whether video, data, 
audio or graphics. The audio is preferably forwarded to the Dolby digital processing 
IC 380. The selected video and audio is then decoded, as explained below, and the 
video is sent to the video digital-to-analog (D/A) converter 388 which prepares the 
selected video for display. 

A phase lock loop (PLL) recovers the encode dock, which was encoded in the 
PGR portion of the MPEG adaptation field. Preferably, a ROM holds the operating 
system for the icception unit 342 and is backed up with Flosh-ROM to aUow for 
downloadable code. Further, there are memory devices connected to the 
decoders 372. 380 and graphic chip 376, which are used to store graphics overlays, for 
example. Furthermore, profile data for various users in the home can be stored in 
nonvolatile RAM or ROM 352. 

A backchannel encoder and modulator 368 are present for sending data back to 
the headend. Such data may conqxrise personal profile mfonnatlon, mteracUve 
selections, demogrq>hic data for tatgeted advertising purposes, game show scores, etc. 

Further, the reception unit 342 permits new software appHcations to be 
downloaded to the unit. These applications can control the unit and redefine die 
functionality of the units within the constraints of the hardware. Such control can be 
quite extensive, including control of the fronti>anel display, the on-screen display, all 
input and output ports, the MPEG Decoder, the RF tuner, graphics chip and the 
mapping of the IR remote functions. 

Preferably, the interactive programming technology, mcluding providing for 
multiple camera angles, individualized advertising, etc., of the present m vention is 
inq>lementcd as a software qjplication withm the rccqjtion unit 342. Such technology 
is preferably located withm ROM or Hasb-ROM 352 of the reoeinion unit, shown in 
Rgure 7. The interactive technology, however, could alternatively be located in any 
type of memory device including RAM, EPROM, EEPROM, PROM. etc.. As such, 
the software shall have access and control over the hardware elements of the device. 
In the preferred embodiment, no additional hardware is required for ftill use of the 
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interactive progrannmng technology within the reception unit 342 to achieve the 
performance described above. 

Any type of conventional remote control device 348 can be used with the 
present invention. It is preferred, however, diat die remote control device 348 be an 
infrared (IR) device and include four or more option buttons and their associated IR 
codes. 

Seamless video switching at the reception unit 342 is explained in the 
paragraphs below. The reception unit 342 shown in Figure 7 preferably is citable of 
real-time MPEG-2, MPBG-4 or MPEG-7 decoding. The reception unit 342 monitors 
user interactions and information transnutted from the p rogr am source and seamlessly 
switches video and audio streams as s^ropriate. 

Based upon the viewer's responses and requests, the unit automatically and 
seamlessly switches between video, grq)hics and audio programming sequences 
reflecting the viewer's earlier responses. The interactive technology of the present 
invention pennits a high level of interactivity while not requiring the set top unit 342 
to transmit any inf cnnation back to the programming source. 

In the video decoder 372. shown in Rgure 7. the header data is stripped off the 
MPEGstream, The particular video is then selected based on a command fiom the 
host processor 360. The associated audio Is sent to the audio decoder portion 380. 
The selected video is buffered in a standard video buffer and then output for decoding. 
The physical buffer size is defined by the MPEG standard, herein incorporated by 
reference. Enough time must be allowed at the initial onset of decoding to fill up the 
buffer with I-frame and other data. 

After bulTering, the selected video goes through various steps of an MPEG 
decode process, wlhich utilizes a variable length decode (VLD) preferably. G^eiaUy, 
the variable length decode conveits the run-length encoded datastream and converts it 
into its longer bitstream format Hie bitstream is decoded into its constituent parts i.e. 
motion vectors, dct coefficents and the like so that the video can be reconstrocted. 
Subsequendy. the datastream is converted into frequency domain information using an 
inverse Discrete Code Transform DCT filter. If die frames are interceded, the pixel 
data is generated and stored in a buffer. 
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Referring to Rgure 7, the seamless switch from one to another MPEG video 
stream is explained. Switches will occur on video splice points, as shown in Figure 6. 
When the demux/decoder 372 in Figure 7 sees the splice point, it switches to the 
selected video signal which is sent to die bulfer. Thus, prior to the switch, the first 
video signal frames arc still being buffered. The next signal PBD is loaded into the 
decoder 372 from the host processor 360. In order to acconqilish a switch to one of 
the four video streams, the vidieo decoder 372, shown in Figure 7, must identify the 
PID nuntiberof the new video stream. Rir&er, it is preferred that each tecoming 
video and audio stream shall have its own PID, known to the interactive application 
stored in memory at the set top converter 342, in order to facilitate seamless switching 
among the independent video and audio streams. It must then call the routine that 
performs the switch. This next PID, identifying the next selected video signal, can be 
based on eidier user selection or by way of the interactive control codes or both. Once 
the next PID Is loaded, the decoder 372 begins to look for the selected video stream 
and, because of the gq> 340 created in the video datastream, the decoder 372 will 
always find die head^ information of the next video. Once the splice point indicator 
of the first video is seen by the decoder 372 and the second video signal is identified 
by the decoder 372. the second compressed video signal begins to load into the buffer 
as the first video signal continues to plays out. The new video signal is selected based 
on either user selection or based on an interactive control code. 

One of the items necessary for a seamless switch is the splice point counter 
and a splice point flag. Bodi of these indicators are placed in the adaptation field of 
the MPEG video streams. The splice point counter indicates the number of video 
packets prior to the splice point. The splice point flag indicates that the splice count is 
present in the stream. Once the decoder 372 determines the splice point, it can begin 
buffering the next video stream and continue decompressing the signal as if it were 
one MPEG stream. 
Audio Switching > 

As with the video streams, preferably four AC-3 audio streams, each of which 
is identified by a unique PID. exist per service. PID numbere are obtained from the 
MPEG-2 transport table such as SI, PG, and PM at the invocation of the interactive 
service. One of these PIDs is selected as the default audio channel and is selected 
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upon acquisition of a service. The remaining three channels arc optional and shall be 
selected by the Control Program based on Control Messages and/or User Input. While 
audio channels normally switch with the associated video channel, they may also be 
switched independently. 

In the preferred embodiment, switching occurs on frame boundaries, as shown 
in the digital firame rq)reseotation 392 of four audio streams of Hgure 8. When 
switching from one channel to anoflier, one frame may be dropped (in this case, frame 
5), and the audio resumes with frame 6 ofthe new channel. The audio decoder 380 is 
c&pablt of audio switching by provision of fte insert of audio splice points at the 
encoder 312, shown in Figure 5. Preferably, the encoder 3 12 inserts an appropriate 
value in the splice countdown slot of the adaptation field of the current audio frame. 

When the audio decoder 380 detects this splice point the decoder 380'may 
switch audio channels, Although the audio splice is not seamless, the switch will be 
nearly imperceptible to the user. 
Data Commands 

Because the data conmiands are time sensitive in the digital embodiments, 
they are sent from the headend vk a command data PID (Packet Identification). The 
commands must be synchronized with video GOP*s at the encoder end. In order to 
accomplish this, the data codes computer 316. shown in Figure 5, must send 
individual commands as a whole packet. Each command can consist of as few as two 
bytes. Therefore, the generator must pad the rest of the packet with code FF (hex) 
bytes. When this whole packet is sent to the encoder 312, the encoder 3 12 will 
transmit it at its earliest convenience. If a partial packet is sent to the encoder 3 12, the 
encoder 312 does not send the command until subsequent commands filled the 
remainder of the packet 

The commands, as identified in (1) ACTV Coding Language, Educational 
Command Set, Version 1. 1, and (2) ACTV Codmg Language, Entertainment 
Command Extensions. Version 2.0, both of which are herein incorporated by 
reference, are formed by stringing together two to six byte long commands. The 
command data is presented to the encoder's ISO interface and packet stuffed to ensure 
timely transmittal of the command data. 
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The Control Program is preferably stored in RAM 352. The processor 360 
receives instructions from the Control Program. Further, key inputs such as user 
responses, peisonal profile information as well as control messages are used by the 
processor 360 in making switching decisions. 

Preferably, the Control Program operates in five modes as determined by the 
received interactive command messages. The five modes arc as follows: 

• Switch Audio and/or Video Based on User Input 

• S wltdi Audio based <» User input and stored data 

Switch Audio and/or Video based on Vscr Inpat and stored data 

• Switch Audio and/or Video based on Control Messages 

Switch Audio and/or Video based on Control Messages and stored 
previous input. 

Multiple modes may be used by the Program simultaneously. 

The first mode above, switch audio and video channels, is the simplest mode 
of operation. The Control Program Is commanded by the microprocessor 360 to 
accept one of the four Remote input ki^ codes and to switch to the conx^ponding 
audio^video channel. The Program performs this switeh on the video frame boundary 
at the end of the current GOP. Once the new channel is displayed, the Program has 
the capability to update the On-screen display with new text and/or graphics messages 
either received in the datastream from the headend or stored locally. 

The second mode above. Display One Video Channel and Switch Audio 
Channels, continuously displays a single video channel. When a remote input key 
code is received, the video continues but the audio channel is switched on the 
appropriate audio frame boundary. As mentioned above, the appropriate audio frame 
boundary is determined by examining the splice point counter value in the adaptation 
field. The choice made by the user is stored in a RAM register. Any time a choice is 
made by the user, the key code and die previously stored choices are reviewed by the 
Program to determine the next audio channel. 

The third mode identified above. Switch Audio/Video Channels Based on 
User and Previous Choices, displays an initial audio/^vidco channel. When 
commanded by the Command Message stream, text is displayed on the On-Scrcen 
display. The Program then waits for a user input. When the user input is received, it 
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is stored in a RAM register along with previous user choices. The register is 
examined by the Program and then, based on stored logic, determines the next 
audio/video channel to be displayed. 

The fourth mode identified above, Switch AudioA^ideo Channels Based on 
Control Messages, also displays an initial audio/video channel. The Pix>gram then 
waits for a control input from the Control Message stream. Based on this input, the 
Program switches channels on the video frame boundaiy at the end of the current 
GOP. 

The fifth mode above. Switch Based on Control Messages and Previous 
Choices, displays an initial audio/video channel. The Program then waits for a control 
mput from the Control Message stream. When the Control Message input is leoetved, 
it is stored in a RAM register along with the previous user and control message 
choices. This register is then examined by the Program to determine the next 
audio/video channel to be dis|dayed. 
Digital Video Systems and Applications 

The following paragraphs disdose several applications using the digital 
embodiments disclosed above in Figures 1-8 and the two nmer embodiments, 
described below, of Figures 16 and 17. 

TV Broadcast Station Switching 

In this embodiment 412, the seamless switch from one signal to another signal 
is done at a TV broadcast conlrol center and forwarded to the users* digital reception 
sets 408, as shown in Rgure 9. At the headend 396, scvearal digital programs are 
combined according to any of the methods explained above. 

Upon receipt of the programs by the broadcast station, the signals arc fed into 
a digital stream selector 400. Hiis selector comprises the elements discussed above in 
any of the alteniacive embodiments for pciforming a seamless switch (Figure M, 7, 
15-17), except for the fact that this unit is not located at the remote sites. The unit 
works in the same manner as discussed above. Regardless of whether the digital 
stream selector 400 selects amongst multiplexed signals in one datastream on one 
channel, centered on a cenain frequency, or between signals in different datasircams, 
or from a received signal to a locally inserted ad, all such switches arc seamless in the 
embodiment shown in Figure 9. As discussed above, selections can be made as a 
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function of station prerogative, remote user seledtions and/or personal profile 
. information (transmitted to the TV station via a backchannel), or taigeted adveitising. 

Once a selection is made the program signal is transmitted by any 
conventional means 404 to the remote sites 408 for presentation. 
Non-related Program Switohinf 

Figure 10 discloses an embodiment 430 for switching between non-related 
programs. In other words, this is simply switching from one TV channel to the next 
TV channel. Presently, switching from one signal to another cannot be accomplished 
without flicker in the digital environment. 

In the present invention, a viewer may switch from one program to another 
program, whether related or unrelated, and the transition will be seamless. In other 
words, there will be no visible artifacts present in switching from one pfograin to 
another program. 

If the programs are compressed and multiplexed within one MPEG stream, 
any of the embodiments disclosed herein are cq>able of perf<»mmg the seamless 
switch. If the progi:ams are in 8epa^ae^^^Cchannek, one of the digital 'two tuner^ 
embodiments (Figures 4. 16 and 17) must be lised to allow for the frequency shift 

The high level elements of the system 430 for non-related program switching 
are shown in Rgure 10. Preferably, the non-related programming is compressed and 
multiplexed asing an MPEG stream into one datastream using one NTSC channel at a 
video encoder chassis 416. Ncm-related progranmiing can be combined into one 
MPEG stream or can be in directed into different NTSC channels. For example, 
progranuning may consists of sports, news, sitcom or children's programming. These 
programs are modulated at a modulatot/upconverter 420 and transmitted across any 
suitable transmission means 429 as discussed above. 

End useis are capable of viewing digital programming on either a digital 
monitoi/tuner, a personal computer or through an external converter 428, connected to 
an analog television set, in which case the seamless switch is performed in the 
converter. Either of these various components allows a user to "surf channels based 
on a viewer's preferences. Again, the reception unit can be selected from any of the 
alternatives explained in Figures 1-4, 7, 15-17. 
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Seamless Switching within Multiple Event Prpgrammine 

In this q^lication, shown in Figure 1 1, a system 450 is provided for allowing 
a user to switch between separate events within a single program. For example, an 
Olympics broadcast may simultaneously comprise several programs corresponding to 
different events, e.g. skiing, speed skating, figure skating, ski jumping etc. Preferably, 
these s^arate event programs are compressed and multiplexed into one MPEG digital 
stream at the video encoder chassis 434, passes through the 
modulator/upconvoter 438 and transmitted as a single NTSC signal via the 
transmission means 442. These ev^t programs, however, may also be ^coded at the 
broadcast center onto separate NTSC channels. 

After modulation and subsequent transmission, these programs are received at 
the remote sites 446. The renK>le sites 446 include a reception unit, which contains * 
cither a digital monitor/tuner, a personal computer, or a external digital converter 
connected to a monitor. The user may select between the different programming 
events via his or her remote control device. When the user desires to switch to 
another evrat program, tiie switch wiU be p^ormed seamlessly according to any of 
the methods and systems discussed above (Figures 1-4, 7, 15-17). 
Seamless Picture^in-Picture Program Switching 

Figure 12 disclo.scs an embodiment 470 for switching between preferably non- 
related programs using "picture-in-picture". Regardless of whether the user is 
switching between programs in the small framed display or the large framed display, 
all such switches are seamless with the present invention. 

hi the present inv^tion, a viewer may switch from one program to another 
program in either of the two displayed windows. In other words, there will be no 
visible artifacts present in switching from one program to anoth^ program. 

The hi^ level elements of the system for picture-in-picture program 
switching 470 are shown in Figure 12. Preferably, four to seven programs are 
compressed and multiplexed into an MPEG stream into one datastieam on one NTSC 
channel at the video encoder chassis 454. Other programs are combined iiito other 
MPEG datastreams at the video encoder chassis 454. For example, programming may 
consists of sports, news, sitcom or children's programming. These programs are 
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modulated and transmitted across any suitable transmission means 462, as discussed 
above. 

End users are ci^bJe of viewing digital prograniming on either a digital 
monitor/tuner, a personal computer or through an external converter 466, connected to 
an analog television set, in which case the seamless switch is performed in the 
conveiter. The enobodiment and flow disclosed hi Figure 12 allows a user to invoke 
the pictuie-in-picture feature and seamlessly switch between different programs 
witfun a single MPEG stream. If switching from one MPEG multiplexed stream to 
another is desired, the converter, PC or digital monitor/tuner 466 will require the 
employment of a multiple tuner/decoder, examples of which is shown in Figures 4, 16 
and 17. 

Switching within Multiple Commeroe/Shopping Programming 

One implication of the current invention involves a transaction based system 
with return paths, as shown in Figure 13. As with the other embodiments discussed 
above, the video encoder 474 compresses and multiplexes several diffetrat programs 
onto one or more NTSC chaimels for transmission to the remote sites. 

Preferably, several different types of shopping programs are compressed and 
multiplexed onto a single NTSC channel. For exainple, sqiarate programs may be 
directed at clothes, jewelry, housewares, etc. If more programs arc necessary than 
aUowable on a single NTSC channel, more than one NTSC channel may be utilized 
by the present inventkm. 

The programs are transmitted to the end user reception units 486, as shown in 
Hgure 13. over any suitable transmission means 482. At the reception units 486, the 
usCT can seamlessly switch between diffmnt product genres. Alternatively, the 
recq)tion unit 486 can switch to certain product programming based on personal 
profile or demographic mformation. In this manner, only thasc products which most 
closely match or suit a particular individual's interests and desires will be presented to 
the user. Such data can be stored in either storage in the reception unit 486 or at the 
headend. 

If the user determines that he or she would like to purchase or receive 
additional information regarding a product, the backchannel 490, such as that shown 
in Rgure 10, can be used to transmit such requests back to the central location. 
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Digital P rogram Insertion — Addressable Advertisin p ; 

Rgure 14 discloses an embodiment 526 for providing digital program 
insertion. At certain {Hedetermined times during the programming, certain 
advertisements are displayed to the viewer. In the prcfened embodiment, 
advertisements arc individualized to the particular viewer based on personal profile 
infoimatioD or demogr^hic information. Such targeted advertising is described in 
the following paragn^hs. 

At the central location, a plurality of advertisements is inserted into the 
programming stream. Preferably, the central location uses a hybrid digital insertion 
system fox insertion of the advertisements into the programming. Hybrid digital 
equipment replaces the tq)c decks of the analog system with computers, disk dri ves 
and decoder cards, as set forth in the CableLabs Cable Advertising White Paper, 
herein incorporated by reference. The advertising content 506 may originate from any 
one of a number of possible sources, including, but not limited to, swver, tape decks, 
satdlite feed. For storage, preferably the spots are digitaUy encoded and compressed 
in an off-line process, using MPEGl, MPEG1.5. MPEG2, or a proprietaiy method. 
Distribution from the encoder to the server and to the playback systems can be done 
through a network or by disk or tape. 

After encoding, the spots are distributed to a server for storage until required 
for playback. Preferably, a spot can be played direcUy from the server to a decoder 
card, for conversion back to analog. The spot is converted to analog, then sent 
through the insertion switcher in the conventional manner. The output video and 
audio would then be forwarded to the audio and video encoder shown in the central 
site configuration in Kgure 5, after which the spots arc digitaUy encoded and 
conq)ressed as described in the paragraphs above, with reference to Rgure 5. 

Although not as efficient as digital advertising insertion, the actual switching 
of the advertising into the programming can also be accomplished, with convendonal 
advertising insertion systems, using analog or t^ ba.sed systems. 

The placement and display of advertisements into the programming stream are 
controlled through the use of signaHng and addressability command insertion 498. 
Personalized advertising can be cfectuated by addressing certain advertisements for 
certain viewers. For example, a certain car company wants to individualize its 
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commercial to best meet the needs and desiies of the viewer. If it is known that a 
particular user is male and enjoys outdoor acUviUes, the programmer may want to 
show the advertisement corresponding to ihe Car Company's Sports Utility Vehicle as 
opposed to a small economy car. The advertisements can be pushed to the end user 
based on data stored at the remote end user unit or in the stream addressed to the end 
users device via the set-top controller in the provider's headend. 

Preferably, several advertising options are encoded according to the manner 
described above with lefercnce to Figure 5. Because the advertising spot videos arc 
gealodosd and time synched at the cncodw 510. switching torn the main 
programming to one of the advmisemrats will q^pear seamless to the viewer. 
Seamless Switching fiom a Group of Sip na ls to another Gtodp of Sfp inaU at ^ 

In another embodiment of the present invention, the process of switching 
among live and served video content is described. As opposed to switching from a 
single digital signal to another single digital signal at the remote recepUon units, this 
embodiment allows for a seamless transition from one group of signals to another 
group of signals. It is necessary that the transition take place in a manner such that the 
ou^ut bitstrcam is continuous and correct to die KfPEG syntax. Proper switching 
ensures that any standard MPEG decoder plays the resulting bitstream as if it were a 
stream with no errors. 

The preferred embodiment 530 for performing this switch is shown m Figure 
15. The elements of Figure 15 are located at a cable headend or alternatively, at a 
centraKzed op center for a satellite distribution network. For puiposes of explanation, 
a group of live signals arc denoted as the Group A signals and die Group B signals are 
presumed to be stored prerecorded signals, preferably stored at the senrer 550. For 
example, the Group A signals may comprise several videos representing different 
camera angles at a sporting event The Group B signals may represent a series of 
commercials. It is understood, however, that both the Group A aqd/or Group B 
signals could represent either prerecorded or live signals. 

In this embodiment, it is desired to switch from the Group A signals to the 
Group B signals. The Group A signals are received at the server 5i50 from a real time 
encoder 546, located either locally or at a remote site. A specialized MPEG digital 
packet is inserted into the Group A content stream on a specific channel. The 
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Command and Contiol terminal 534 provides an analog tone in the video signals prior 
to analog-to-digital conversion. Once the signals reach the Real Time Encoder 546 
from the Command and Control terminal 534, the Real Time Encoder 546 inserts a 
digital tone at the appropriate point in the Group A digital stream upon detection of 
the analog tone. Once the tone is inserted, the Group A digital stream is output from 
the Real Time Encoder 546 and forwarded to the Server 550 at the headend. Once 
received at ibc server, Ac Group A stream is forwarded to an MPEG transport switch 
device in the servw 550. Hie Control Tenninal 538 sends a command to the MPEG 
transport server switch device to cause the switch to begin looking for the inserted 
digital tone. 

In order to play back the Group B content, the server switch device must 
decode timing information from die Group A digital stream and subsequently, rcstamp 
the Group B content with the appropriate timing signals from Group A. Preferably, 
this is accomplished by genlocking to the PCR's vidcostream, preferably the same 
stream with the digital tone embedded therein, and stripping out the program clock 
reference (PGR) out of the vidcostream to recreate the encode clock of ttie original 
Group A content At this point, the switch device has the ability to re-inseit the 
timing information into the Group B content to prepare it for piayout. 

Upon detection of the digital tone, the server switch device initiates a 
transition to the Group B digital stream, comprised of the Group B prerecorded 
signals. Preferably, the server switch device has prior knowledge of the length of the 
Group B content and, therefore, when the server switch device senses the end of the 
Group B content, it switches back to the Group A content. The resulting digital 
stream ou^t from the server to the transmitter cominises both Gioup A and Group B 

content The transniitter 554 forwards the digital data stream to the remote reception 
sites, as previously described. 

In this manner, at certain times during the presentation of a sporting event, 

represented via the plurality of live digital video signals Cte., the Group A content), 

for example, the received vidcostream at the receive converter units will automatically 

transition to the Group B prerecorded content based on the action by the server switch 

device, for example. The decoder at the reception sites then selects one of the 

advertisements in the Group B content, as previously described. At the end of the 
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advertisements, the decoder automaticaUy begins receiving the Group A content again 
and selects one of the live signals, as previously described. In this manner, a seamless 
switch from live encoded video content to prerecorded content is effectuated at the 
server. 

Two Ttmer Embodiments for Seamless Switching 
Digital Stream to IMgital Stream Switch 

A two tuner embodiment 558 for providing seamless switching from a digital 
signal located in one finequency channel (hcndnafter, •H3iannel A'O to anoth^ digital 
signal located in another frequency channel (hereinafter, Channel B-) is shown in 
Figures 16A and i6B. 

As shown in Figures 16A and 16B, this embodiment comprises two 
tuners 560A, 560B (for tuning to separate frequency channels), a microprocessor 564 
(for selecting the frequency channels and digital signals embedded therein), digital 
demodulators 568A, 5d8B (for demddulatmg the signals from the carrier), a digital 
denuw/decoder 572 (fw stripping out the selected audio, v^ and data of the 
selected content from the composite digital stream) and a display processor 576 (for 
fonnatting ibt video signal for display). 

This embodiment operates to switch from one digital data stream in Channel A 
to anothCT digital data stream in channel B as follows. A first tuner 560A is tuned to 
Channel A and is receiving a composite digital stream, preferably comprismg a 
plurality of digital video, audio and/or data signals, in the associated frequency 
channel. The composite digital stream is passed from the first tuner 560A to a digital 
demodulator 568A. The type of demodulation can be any oftho.se conventionally 
known m the art, sudi as those described above. 

The composite digital stream is then directed to the input of the digital 
demnx/decodcr 572, wherein the selected audio and video signals are stripped from 
the composite digital stream in a demux 573 and forwarded to the audio and video 
decoders 575, 574. respectively. Those signals are then deconqjressed and decoded 
based on the signal encoding scheme, preferably one of the MPEG schemes. Once 
decoded, the audio and video (and/or data, if appropriate) are forwarded to the display 
processor 576 and subsequendy to the monitor. 
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Once a decision is made to switch to another digital signal in frequency 
Channel B, the ndcroprocessor 564 sends a command to the second tuner 560B to 
pretune to the Channel B frequency. Hie composite digital stream in Channel B is 
passed through the digital demodulator 568B and forwarded to the digital 
demux/decodcr 572. At this time, the digital demultiplexer 572 receives both the 
digital streams located on Channel A and Channel fi. Thus, if both Channel A and 
Channel B carried fcwr digital signals, the demultiplexer 572 receives eight digital 
signals. The digital demuldplexer 572 receives a command fiom the 
microprocessor 564 indicating which of the digital signals to strip out fiom the 
composite digital stream from Channel B. Separately, the digital demultiplexer 572 
strips out die selected video and audio (and/or data) signals fiom the composite digital 
streams from Channel's A and B. TTie selected signals arc forwarded to the video and 
audio decoders 574, 575. The video decoder 574 switches from the currcndy 
displayed video signal to the newly selected video signal as described above with 
reference to Kgures 6 and 7. Therefore, the decoder 574 identifies the splice point in 
the present stream. Once the decoder 574 detects the splice point, it determines that it 
is the appropriate thne to switch to the second stream. The decoder 574 begins 
loading the second stream into the bufifer and a seamless switch is effectuated because 
of the time gap in the first stream. Once the second stream is ou^t from die decoder, 
it is forwarded to the display processor 576, where the video signal is formatted for 
display. 

The audio decoder 575 performs the switch from the present audio sueam to 
the second audio stream, in the same manner as described above with reference to 
Figure 1 1 . Once the switch is con^letcd, the second audio stream is forwarded to the 
displs^ processor 576. 

Switch fino m Analog Signals to Digital Signals or Digital Signals to Analog Signals 

A two tuner embodiment 590 for switching from an analog^ signal located in a 
first RF channel to a digitally compressed signal in a second RF channel or vis versa 
is shown in Rgurc 17. hi this embodiment, a viewer is watching a particular charmel, 
whether it be an analog or digital signal, in one specific RF frequency and there is a 
decision made to switch to another channel, whether it be analog or digital, in a 
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different RF frequency. Tvw) tuners 560A, 560B are used to transition fit)m one RF 
frequency to a difTerent RF frequency. 

Assuming by way of example that the viewer is currently watching a channel 
(Channel A) with an analog signal and the decision is made to switch to a digitally 
con^rcssed signal in a different channel (Channel B), the embodiment of Figure 17 
operates as follows. With respect to the analog signal, one of the tuners 560A tunes to 
the RF frequency associated with Channel A. Because the channel canies an analog 
signal, the tuner 560A iUrects the signal to the analog demodulator 569A and VBI 
decoder 570A. The analog demodulator 569A d^nodulates the analog signal usmg 
any conventional analog demodulation scheme known in the art The VBI 
decoder 570A scrips out any information (e.g., interactive c(»nmands» close 
captioning) embedded in the vertical blanking interval (VBI). The demodulated 
analog signal is then forwarded to the analog display processor 580, which formats the 
analog signal, and then ouqjuts it to the VBI switch 588 and then display device. 

If a decision is made to switch to a channel containing muxed and compressed 
digital signals, the microprocessor 564 detemunes the RF frequency location of this 
channel and forwards the information in a command to the second tuner 560B. Upon 
rece^>t of the command, the second tuner 560B pre-tunes to the indicated second RF 
frequency (Channel B). The ouQwt of the Channel B Is forwarded to the hiput of the 
digital demodulator 568B. which demodulates the signal using any of the digital 
demodulation schemes known in the art The digital data stream is output from the 
demodulator 568B and received at the digital demux/decoder 57Z Tht 
microprocessor 564 sends a command to the digital demux/decoder 572 indicating the 
selected digital signal. The digital demux/decoder 572 demultiplexes the plurality of 
digital signals and deconqiresses such signals. The resulting selected constimeni parts 
(audio, video and data) are then forwarded to the appropriate decoders 574. 575 (see 
Fig. 16BX as described above with reference to Figure 16, whereby the video 
decoder 574 begins to decode the video information and sends a signal to the 
microprocessor 564 signaling that the stream was properiy decoded and that the audio 
was in lip synchronization. 

The video and audio signals arc dien forwarded to the digital display 
processor 584, wherein the signals are converted from digital to analog. The resultant 
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analog signals corresponding to Channel B are then input into the VBI switch 588. 
Upon command from the microprocessor 564 to switch the two videos, the VBI 
switch 588 switches during the appropriate time during ttie vertical blanking interval, 
resulting ui a switch from the analog to the digitaJ channel. 

iff it is desired to switch from a digital channel to an analog channel, the 
process identified above is simply reversed and the second tuna: 560B pro-tunes to die 
analog channel. Fkiithcr, die embodunent shown in Flgiiie 17 can switch from ana^ 
to analog channels. 

Although the present invention has been described in detail with respect to 
certain embodiments and examples, variations and modifications exist which are 
within the scope of the present invention as defined in the following claims. 
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CLAIMS 

1 . A seamless switching unit for receiving programming and performing a 
seamless switch from a fkst digital video signal to a second digital video signal, 
comprising: 

a miooprocessor* the microprocessor selecting the signals for display; 

a digital demodulator, connected to the mictopiocessor, for receiving and 
demodulating a program signal, the program signal containing the first and second 
digital video signals; 

a digital demultiplexer/decoder, connected to the firist digital demodulator and 
microprocessor, for demultiplexing the program signal to obtam the first and second 
digital video signals, and directing the first digital video signal into a buffer, and for 
decompressing the first digital video signal; 

wherein, upon command fiom the microprocessor to switch to the second 
digital program signal, the digital demultiplexet/decoder searches for the splice point 
of the fiist digital video signal and upon recognition of the splice point, loads the 
second digital video signal into the buffer as the first video signal continues to play 
out of the buffer, and wherein the switch fiom the first video signal to the second 
video stream is seamless. 

2. The seamless switching unit of claim 1 wherein the first and second digital 
video' signals comprise one or more regular television program signals. 

3. The seamless switching unit of claim 1 wherein the first and second digital 
^dco signals comprise one or more interactive program signals of an interactive 
program. 

4. The seamless switching unit of claim 1 wherein the first and second digital 
video signals comprise one or more advertisements. 
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5. The seamless switching unit of claim 1 wherein the seamless switching unit Is 
implemented in a subscriber reception unit, the subscriber leception unit receiving 
programming finom a subscriber distribution network selected from the group 
consisting of cable tdevision, broadcast television, and direct broadcast satellite. 

6. The seamless switching unit of claim 1 wherein the first and second digital 
video signals comprise different camera angles of die same event 

7. The seamless switching unit of daim 1 wherein the seamless switching unit is 
implemented in a subscriber reception unit, the subscriber reception unit con^wising a 
television monitor for displaying the first and second digital video signals. 

8. The seamless switching unit of claim 1 one of the digital video signals 
contains a close-up view of an ev^t. 

9. The seamless switching unit of daim 1 wherein die digital video signals are 
transmitted over a single cable channel. 

10. The seamless switching unit of daim 1 wherein the digital video signals are 
transmitted over a six MHZ NTSC channel. 



11. The seamless switching unit of claim 1 wherein the seamless switching unit is 
implemented in a subscribar reception unit, wherein a personal profile is created and 
the subscriber reception unit further conqjrises a memory for storing the personal 
profile, and wherein the first or second video signals arc selected based m part on the 
personal profile. 

12. The seamless switching unit of claim 1 wherdn the seamless switching unit is 
implemented in a subscriber reception unit, wherein the subscriber leception unit 
comprises a subscriber interface for receiving subscriber selections and wherein the 
first or second video signals are sdecled based on one or more subscriber selections. 
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13. The seamless switching unit of claim 1 wherein the seamless switchmg unit is 
implemented in a subscriber fecq)tion unit, wherein the subscriber reception unit 
comprises a digital display processor, connected to the output of the digital 
demultiplexer/decoder, for receiving and formatting the selected video signals for 
display. ^ 

14. A seamless switching unit for receivmg prognmming and performing a 
scainless switch fion a first digital video signal mdtiple^ 

received in a first RF channel to a second digital video signal multiplexed hi a second 

program signal received in a second RF channel, coRq>rising: 

a microprocessor, the microprocessor selecting the signals for display, 
a first tuner, cormected to the microprocessor, for tuning to the first F[F 

channel, wherein the first tuner selects the first RF channel on command from the 

microprocessor; 

a fint digital demodulator, connected to the first tuner, for demodulating the 
first program signal; 

a digital demultiplexer/decoder, connected to the first digital demodulator and 
micropn)ccssor, for dcmultiplexittg the first program signal to obtam the first digital 
video signal, containing a buffer for buffering the first digital video signal, and for 
decompressing the first digital video signal; 

a second tuner, connected to the microprocessor, the second tuner pie-tuning 
to the second RF channel, wherein the second tuner selects the second RF channel on 
command fiom the microprocessor, 

a second digital demodulator, connected to the second nmer, for demodulating 
the second program signal; 

wherdn, upon command fiom the microprocessor to switch to the second 
digital video signal, the digital demultiplexci/deooder searches for the spUce pomt of 
the first digital video signal and upon recognition of the splice point, loads the second 
digital video signal into the buffer as the first digital video signal confinues to play out 
upon conunand fix)m the microprocessor, and wherein the switch fiom the first digital 
video signal to die second digital video signal is seamless in that the video stream 
switciung does not produce visible artifacts. 
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15. A seamless switching unit for receiving programming and capable of 
performing seamless switches from either a first analog signal to a second analog 
signal, an analog signal to a digital signal, or a first digital video signal to a second 
digital video signal, comprising: 

a mlcipprocessor, for selecting one of the video signals and directing a 
seamless switch to the selected video signal; 

a pair of tuners, connected to the microprocessor, for tuning to RF channels , 
wheiein the pair of tuners selects the RF channels on command from the 
microprocessor. 

a pair of analog demoduIat«»s, each analog demodulator comiected to one of 
the tuners, and enable of receiving one analog signal; 

a pair of digital demodulators, each digital demodulator connected to one of 
the tuners, and capable of receiving one digital signal; 

a digital demultiplexei/decoder. connected to the pair of digital demodulators, 
for demultiplexing digital signals, decompressing the digital signals, and for 
performing a seamless switch from one digital video signal to another digital video 
signal; 

a digital display processor, connected to the output of the digital 
demultiplexer/decoder, for converting the decompressed ou^ut distal signal to an 
analog signal; and 

a vertical blanking interval switch, opcrably connected to the output of the 
digital demultiplexer/decoder and the ouqjut of the analog demodulator, for 
seamlessly switching between the analog video signals. 

16. A seamless switc^ng unit for receiving progranmiing and performing a 
seamless switch from a digital video signal multiplexed in a first program signal 
received in a first RF channel to an analog video signal muldplexed in a second 
program signal received m a second RF channel, comprismg: 

a microprocessor, the microprocessor directing the switch ftom the digital 
video signal to the analog video signal; 

a first tuner, connected to the microprocessor, for tuning to the first RF 
channel; 
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a digital demodulator, connected to the first tuner, for demodulating the fiist 
piDgram signal; 

a digital demultiplexer/decoder, connected to the first digital demodulator and 
micropn>cessor, for demultiplexing the first program signal to obtain the digital video 
signal, and decomprcssitig and decoding the digital signal; 

a digital display processor, connected to die digital demultiplexer/decoder, for 
conveiting the digital video signal to analog; 

a second tuner, connected to the microprocessor, the second tuner pre-tuning 
to the second RF diannel; 

an analog demodulator, connected to the second tuner, for receiving and 
demodulating the analog signal; 

a vertical blanking interval switch, operably connected to the output of the 
digital/ demultiplexer decoder and the output of the analog demodulator, for 
seamlessly switching fiom the converted digital video signal to the analog video 
signal during the vertical blanidng interval of the signals. 

17. A method of performing a seamless switch between two digital video streams 

in a digital recq}tion unit, the digital rec^tion unit containing a microprocessor and a 

video decoder, con^rising the st^s of: 

receiving first and second digital video streams, each stream containing video 

splice points and time gaps; 

buffering the first digital video sueam in a video buffer, 

receiving a command from a microprocessor to switch to the second digital 

video stream; 

searching for the splice point of the first distal video stream; 

loading thie second digital video stream frames into the buffer as the first video 
signal stream continues to play out and be displayed; and 

wherein the switch from the first digital video stream to the second digital 
video stream is seamless in that the video stream switching does not produce visible 
artifacts. 
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18. A method for preparing a plurality of digital signals at a central location for 
seamless switching at subscriber reception sites, comprising the steps of: 

receiving a plurality of video signals at the central location; 

genlocking the pluraliy of video signals, wherein genlocking creates time 
synchronized video signals; 

directing the plurality of video signals into one or more video encoders; 

inserting splice points into the plurali^ of video signals; 

time ^chroniaung the plurality of video encoders, tiieieby ensuring that the 
splice points inserted in the video occur at a conea frame number, 

digitaUy conqyressmg the plurality of digital video signals in the video 
<^coders, forming a digital program stream, whetcin the digital video signak are 
encoded at a lower bit rate than channel capacity resulting in creation of c^tain time 
gaps in each of the video signals; 

wherein program switching from one video signal to another video signal at 
the subscriber reception sites is made seamless through the creation of the time gaps, 
the time gaps vqnesenting switch times thereby allowirig thne for a seamless switch 
from one of the video signals to another video signal. 

19. The method of claim 18 wherein a plurality of digital program streams are 
created, and further comprising the step of multiplexing the plurality of digital 
program streams. 

20. The method of claim 1 8 wherein a plurality of audio signals are associated 
with the plurality of video signals and farmer comprising the steps of receiving the 
plurality of audio signals, encoding the phurality of lecdved audio signals and 
compressing the phirality of audio signals. 

21. The method of claim 18 wherein the encoder receives i plurality of data 
computer codes and further comprising the step of encoding the reed ved plurality of 
data computer codes with the plurality of video signals. 
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22. A digital eaooding system for preparing a plurality of digital signals at a 
central location for seamless switching at subscriber reception sites, comprising: 

at least one video genlock device, for leceiving the plurality of video signals 
and creating time synchronized video signals; 

at least one video encoder, connected to the video genlock device, for inserting 
splice points into the plurality of video signals, and encoding and compressing the 
plurality of video signals to form a digital program stream, vrherein the video 
encoders are time synchronized; 

wherdn the digital video signals are encoded at a lower bit rate than channel 
capadty resulting m oeation of certain time gBps m each of the video dgnals, the time 
gaps lepies^ting switch times thereby allowing time for a seamless switch from one 
of the video »gnals to another video signal. 

23. The digital encoding system of claim 22 wherein a plurality of digital program 
streams are created and further comprising a multiplexer for multiplexing the plurality 
of digital program streams. 

24. The digital encoding system of claim 22 further comprising a transmitto: for 
tcansmittliig the plurality of digital program streams onto a subscriber distribution 
netw<»k selected from the group consisting oif cable television, broadcast television, 
and direct broadcast satellite. 

25. The digital encoding system of claim 22 wherein a plurality of audio signals 
are a.ssociated with the plurality of video signals and the encoder receives the plurality 
of audio dgnals and encodes and decompresses the plurality of audio signals. 

26. The digital ^coding system of claim 72 wherein the encoder receives a 
plurali^ of data computer codes and encodes the data computer codes with the 
plurality of video signals. 



27. The digital encoding system of claim 23 wherein at least one of the video 
signals con^rises a regular television program signal. 
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28. The digital encoding system of idaim 22 wherein the at least two of the video 
signals comprises intciwlive program signals of an interact!^ 

29. The distal encoding system of claim 22 wherein the plurality of video signals 
convulse one or more advertisements. 

30. The digital encoding system of claim 22 farther comprising a transmitter and 
wherein the transmitter transmits programming to a subscriher distribution network 
selected ftom the group consisting of cable television, broadcast television, and direct 
broadcast satellite. 

3L The digital encoding system of claim 22 wherchi at least two of the plurality of 
video signals comprise different camera angles of the same event. 

32. The digital encoding system of claim 22 wherein at least one of the digital 
video signals contams a close-up view of an event 

33. The digital encoding system of claim 22 wherem the digital program stream is 
tiansrrdtted onto a single cable channel. 

34. A system for switching torn a first group of signals to a second group of 
signals, comprising: 

a command terminal* the command terminal inserting an analog tone in the 
first group of signals; 

a real time encoder, in communications with the command terminal, for 
inserting a digital tone in the first group of signals upon detection of the analog tone; 

a server, in communications with the real tinie encode, for receiving the first 
group of signals and a second group of signals; 

a control tenninaU in communications with the servisr, for sending a switch 
command to the server, and 
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wbercin upon receipt of the switch commani the server begins to look for thb 
digital tone, and upon detecting the digital tone, the server switches from the first 
group of signals to a second group of signals in a seamless manner. 

35. The system of claim 34 wherein the first group of signals represent signals 
5 from a live event 

36. The system of claim 34 wherein the second group of signals comprise 
prerecorded content and further comprising a memory for storing the second group of 
signals. 

37. The system ofdaim 34 wherdnd» second groiq) of rignals comprise 
alternative advertisements and further comprising a memory for storing the second 
group of dgnals. 
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38. The system of claim 34 wherein the first and second group of signals are in the 
MPEG encoded format. 

39. The seamless switching unit of claims 1, 14, or 15, wherein the seamless 
15 switcMngunitislocatedatabroadcaststationandfurthercompiiscsam^^ 

transmitting the signals to remote sites. 

40. The seamless switching unit of claims 1 or 14, wherein the first and second 
digital video signab contmn non-related programs. 

41. The seamless switching unit of claim 16, wherein the digital video signal and 
20 the analog video signal contain non-related programs- 

42. The seamless switching unit of daim 1 or 14, wherein the first and second 
digital video signals contain shoK>ing programs directed at the sale of goods or 
services. 
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43. The seamless switching unit of claims I or 14, wherein the seamless switching 
unit is integrated into a remote reception unit, and the first and second digital video 
signals contain shopping programs directed at the sale of goods or services, wherein 
the seamless switching unit further comprises a means for transmitting user selections 
of purchases baclc to a central location. 

44. The seamless switching unit of claims 1,14 or 15, wherein the seamless 
switching unit is located at a central location, wberdn at least one of the signals 
xepresents an advertisement, and further comprising a memory for storing the signal 
containing the adverdscment 
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